Augmented reality system supporting customized multi-channel interaction

ABSTRACT

The embodiments of the present disclosure disclose an augmented reality system that supports customized multi-channel interaction. One embodiment of the augmented reality system comprises: a head-mounted sensor assembly, a computing device, and a display module; the head-mounted sensor assembly is used to capture the user&#39;s multi-channel interactive input information and transmit the interactive input information to the computing device; the computing device is used to generate or modify the display content of the augmented reality according to the interactive input information; the display module is used to overlay display the background content with the display content of the augmented reality. The augmented reality system, by arranging the display module to the far end of the head-mounted sensor assembly, can simplify the structure of the head-mounted sensor assembly, and reduce the weight of the head-mounted sensor assembly, providing convenience for installing other sensors.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority from the Chinese patent application202010476286.6 filed May 29, 2020, the content of which is incorporatedherein in the entirety by reference.

TECHNICAL FIELD

The embodiments of the present disclosure relate to the field ofaugmented reality, and in particular to an augmented reality system thatsupports customized multi-channel interaction.

BACKGROUND ART

AR (Augmented Reality) technology is a novel human-computer interactiontechnology that can add virtual information to the real world, therebyskillfully fusing virtual information with the real world, i.e.,“augmenting” the real world.

Existing AR display technology devices mainly include an AR head-mounteddevice. The AR head-mounted device integrates the display unit into ahead-mounted device, using a near-eye display technology. Although theabove device achieves the integration of components, it increases theweight of the head-mounted device. Therefore, when the user experiencesthe device, it is often too heavy that dampens the user's experience.

In addition, the use of the near-eye display technology usually limitsthe viewing angle of the lens, which will also dampen the user'sexperience.

Accordingly, this field needs a new augmented reality system to solvethe above problem.

Summary Contents

The content of the present disclosure is used to introduce concepts in abrief form, and these concepts will be described in detail in thefollowing embodiments. The content portion of the present disclosure isnot intended to identify the key features or essential features of theclaimed technical solution, nor is it intended to limit the scope of theclaimed technical solution.

To solve the above problem, some embodiments of the present disclosurepropose an augmented reality system that supports customizedmulti-channel interaction, including: a head-mounted sensor assembly, acomputing device, and a display module; the head-mounted sensor assemblyis used to capture the user's multi-channel interactive inputinformation and transmit the interactive input information to thecomputing device; the computing device is used to generate or modify thedisplay content of the augmented reality according to the interactiveinput information; the display module is used to overlay display orsuperposition display the background content with the display content ofthe augmented reality, wherein the display module is set to the far endrelative to the head-mounted sensor assembly.

In some embodiments, the system further comprises an augmented realitywindow displayed to the display module, the augmented reality window isused to display the display content of the augmented reality, and theposition of the augmented reality window is determined through theposture of the user's head relative to the display module, therebysimulating the real effect of the display content of augmented reality;the shape and size of the augmented reality window are determined bysetting the shape of a virtual window, wherein the virtual window is anear-eye window formed by back projection of the augmented realitywindow.

In some embodiments, the position where the augmented reality window isdisplayed onto the display module is determined through the followingsteps: establishing a coordinate system according to the display rangeof the display module; determining, based on the following formula, thepoint coordinates of the point on the boundary line where the virtualwindow is projected to the display module: PA_(i)=λ_(i)PP_(i); wherein Prepresents the coordinates of the center point of the two eyes; P_(i)represents the coordinates of the i^(th) point on the edge of thevirtual window; A_(i) represents the point coordinates of the pointwhere the straight line formed by starting from point P as the originand passing through point P_(i) intersects the display module; PA_(i)represents the distance from point P to A_(i); PP₁ represents thedistance from point P to P_(i); λ_(i) represents the quotient of PA_(i)and PP_(i), and λ_(i) is determined by the Z-axis coordinates of thethree points P, A_(i), and P_(i).

In some embodiments, the computing device determines by the followingformula the object in the display content that the eyeball focuses on:λ₁*λ₂*λ₃>0; wherein λ₁ is determined by the following formula:

$\lambda_{1} = \left\{ {\begin{matrix}{1,\ {{\left( {x - x_{r}} \right)^{2} + \left( {y - y_{r}} \right)^{2} + \left( {z - z_{r}} \right)^{2}} \leq r^{2}}} \\{0,\ {{\left( {x - x_{r}} \right)^{2} + \left( {y - y_{r}} \right)^{2} + \left( {z - z_{r}} \right)^{2}} \geq r^{2}}}\end{matrix};} \right.$

Wherein (x, y, z) are the coordinates of the object in the displaycontent; (x_(r), y_(r), z_(r)) are the three-dimensional focus pointcoordinates of the left and right eye sight direction; r represents theattention radius; wherein the spherical range formed by the attentionradius represents the preset range of the focus point; in response toλ₁=1, it indicates that the object is in the preset range of the focuspoint; and in response to λ₁=0, it indicates that the object is out ofthe preset range of the focus point; wherein λ₂ is determined throughthe following formula:

$\lambda_{2} = \left\{ {\begin{matrix}{1,\ {t \geq t_{d}}} \\{0,\ {t < t_{d}}}\end{matrix};} \right.$

Wherein t represents the time that the focus point continuously selectsthe object within the preset time period, and t_(d) is the presetthreshold of the time; in response to λ₂=1, it indicates that the timethe object has been focused on exceeds the preset threshold; in responseto λ₂=0, it indicates that the time the object has been focused on isless than the preset threshold; wherein the specific formula of λ₃ is asfollows:

$\lambda_{3} = \left\{ {\begin{matrix}{1,\ {x_{\min} \leq x \leq {x_{\max}\ {and}\mspace{14mu} y_{\min}} \leq y \leq y_{\max}}} \\{0,\ {x_{\min} > {x\ {or}\mspace{14mu} x} > {x_{\max}\ {or}\mspace{14mu} y_{\min}} > {y\ {or}\mspace{14mu} y} > y_{\max}}}\end{matrix};} \right.$

Wherein (x_(min), x_(max)) represents the minimum and maximum values ofthe augmented reality display window in the x-axis direction, (y_(min),y_(max)) represents the minimum and maximum values of the augmentedreality display window in the y-axis direction; λ₃=1 means that theobject is inside the augmented reality display window; λ₃=0 means thatthe object is outside the augmented reality display window.

In some embodiments, when the number of objects in the display contentthat the eyeballs have focused on is multiple, the computing devicedetermines through the following steps the order in which the multipleobjects are displayed: for the determined objects that the eyeballs havefocused on, the probability of each object being displayed is determinedthrough the following formula:

${P_{i} = {1 - {\min\left( {1,\frac{d_{i}}{r}} \right)}}};$

Wherein P_(i) represents the probability of the i^(th) object beingdisplayed; d_(i) represents the distance between the i^(th) object andthe gaze point; r represents the radius of the spherical area; based onthe probability of each of the objects being displayed, determine theobject to be displayed first.

In some embodiments, in response to the display module displayingmultiple augmented reality windows, and the object of the displaycontent being within the range of the multiple augmented reality windowsor the object being selected by multiple interactive operations, thecomputing device displays one by one the objects modified by each of theinteractive operations.

In some embodiments, the background content comprises acquired images orvideos, and generated virtual dynamic or static scenes.

In some embodiments, the augmented reality display content comprisesimages or videos, generated virtual dynamic or static scenes or objects,as well as visualization effects of interactive operations. Theaugmented reality display content can be modified in real time byinteractive operations, and only the part of it within the range of theaugmented reality window is displayed.

In some embodiments, the head-mounted sensor assembly comprises at leastone of the following: a camera, a microphone, a gesture sensor, and aneye movement tracking sensor, and the interactive operationcharacterized by the interactive input information comprises at leastone of the following: a gesture interactive operation, a voiceinteractive operation and an eye movement interactive operation.

In some embodiments, the display mode of the display module comprises atwo-dimensional plane display and a three-dimensional space display.When the display module performs the two-dimensional plane display, thedisplay module comprises at least one of the following: a computermonitor, a tablet computer, and a screen projection; when the displaymodule performs the three-dimensional space display, the display modulecomprises at least one of the following: a 3D projector and a 3Ddisplay.

One of the above embodiments of the present disclosure has the followingbeneficial effects: by arranging the display module to the far end ofthe head-mounted sensor assembly, the structure of the head-mountedsensor assembly can be simplified, and the weight of the head-mountedsensor assembly can be reduced, providing convenience for installingother sensors. Furthermore, by setting different sensors, theinteraction between the system and the user is enriched, and the userexperience is improved. In addition, compared with near-eye display, thedisplay module can reduce the limitation of the lens viewing angle andimprove the user's experience.

DESCRIPTION OF FIGURES

The above and other features, advantages and aspects of the embodimentsof the present disclosure will become more apparent in conjunction withthe drawings and with reference to the following embodiments. Throughoutthe drawings, the same or similar reference signs indicate the same orsimilar elements. It should be understood that the drawings areschematic, and the components and elements are not necessarily drawn toscale.

FIG. 1 is a schematic diagram of some structures of an augmented realitysystem supporting customized multi-channel interaction according to thepresent disclosure;

FIG. 2 is a schematic diagram of some further structures of an augmentedreality system supporting customized multi-channel interaction accordingto the present disclosure;

FIG. 3 is an application scenario diagram of an augmented reality systemsupporting customized multi-channel interaction used by more than oneperson according to the present disclosure.

DETAILED DESCRIPTION

Embodiments of the present disclosure will be described hereinafter inmore detail with reference to the accompanying drawings. Althoughcertain embodiments of the present disclosure are shown in the drawings,it should be understood that the present disclosure can be implementedin various forms and shall not be construed as being limited to theembodiments set forth herein. On the contrary, these embodiments areprovided for a more thorough and complete understanding of the presentdisclosure. It should be understood that the drawings and embodiments ofthe present disclosure are used only for exemplary purposes, not tolimit the protection scope of the present disclosure.

In the description of the present disclosure, it should be noted thatsuch terms as “installation”, “connected with” and “connected to” shouldbe understood in a broad sense, unless otherwise clearly specified andlimited. For example, the connection can be fixed, or detachable, orintegral; it can be a mechanical connection or an electrical connection;it can be directly connected or indirectly connected through anintermediate medium, and it can be an internal connection between twocomponents. For a person having ordinary skill in the art, the specificmeanings of the above-mentioned terms in the present disclosure shall beunderstood in specific situations.

In addition, it should be noted that, for ease of description, thedrawings only show the parts related to the relevant disclosure. In thecase of no conflict, the embodiments in the present disclosure and thefeatures in the embodiments can be combined with each other.Hereinafter, the present disclosure will be described in detail withreference to the drawings and in conjunction with embodiments.

Besides, in the description of the present disclosure, the terms “up”,“down”, “left”, “right”, “in”, “out” and other terms indicatingdirections or positional relationships are based on the directions orpositional relationship shown in the drawings, for ease of descriptiononly, instead of indicating or implying that the device or element musthave a specific orientation, be constructed and operated in a specificorientation, and therefore shall not be construed as a limitation to thepresent invention.

It should be noted that such concepts as “first” and “second” mentionedin the present disclosure are only used to distinguish differentdevices, modules or units, not to limit the order of functions performedby these devices, modules or units or the interdependence thereof.

It should be noted that such modifications as “one” and “more” mentionedin the present disclosure are illustrative and not restrictive. Thoseskilled in the art shall understand that, unless clearly statedotherwise in the context, they should be understood as “one or more”.

The names of messages or information exchanged between multiple devicesin the embodiments of the present disclosure are used only forillustrative purposes, not to limit the scope of these messages orinformation.

Hereinafter, the present disclosure will be described in detail withreference to the drawings and in conjunction with embodiments.

Firstly refer to FIG. 1 . FIG. 1 is a schematic diagram of somestructures of an augmented reality system supporting customizedmulti-channel interaction according to the present disclosure. As shownin FIG. 1 , the head-mounted sensor assembly 1 is used to capture theuser's multi-channel interactive input information, and transmit thecollected interactive input information to the computing device 2. Thecomputing device 2 generates or modifies the display content ofaugmented reality according to the aforementioned interactive inputinformation, and transmits it to the display module 5. The displaymodule 5 superimposes and displays the background content and thecomputed augmented reality display content. It should be noted that,different from displaying onto the head-mounted display device in theprior art, the above display module and head-mounted sensor are set tothe far end at intervals. For example, the display module 5 may be acomputer monitor, a plasma display screen, a liquid crystal displayscreen, and so on. Those skilled in the art can make a selectionaccording to the actual situation. No limitation is made here.

To be specific, the aforementioned background content may be an image orvideo displayed in the display module 5. It can also be a virtualdynamic or static scene generated by conventional technical means.Taking the generation of a dynamic scene as an example, first, theelements of this dynamic scene may be determined, namely the target,background, and target movement and the like. Next, the path and angleof movement of the target and so on are determined. In the end, therequired dynamic scene image is generated. Those skilled in the art cangenerate the aforementioned virtual dynamic scene or static sceneaccording to the prior art or conventional technical means.

The above augmented reality display content may include images orvideos, generated virtual dynamic or static scenes or objects, andvisualization effects of interactive operations. The interactiveoperations may be human-computer interactive operations performed by theuser with the system through the head-mounted sensor. Specifically, theinteractive operations may include at least one of the following:gesture interactive operation, voice interactive operation, and eyemovement interactive operation. In order to complete the aboveoperations, relevant sensors can be provided on the head-mounted sensorassembly to collect information. The sensor assembly may include acamera, a microphone, a gesture sensor, and an eye movement trackingsensor. The user's interactive input information is acquired through theabove-mentioned sensors.

Further, the corresponding visualization effects can be presentedthrough the above interactive operations. For example, when a gesturesensor is used, through the acquired user's gesture interactive inputinformation, the effect of the hand moving an object in the augmentedreality display content can be simulated and etc.

In response to receiving the aforementioned interactive inputinformation, the computing device implements the correspondinginteractive operations. In other words, the augmented reality displaycontent can be modified in real time by the computing device throughinteractive operations, and only the part of it within the augmentedreality window is displayed. In this way, the function of the computingdevice generating or modifying the content of the augmented reality isrealized. Those skilled in the art can choose among existing relatedsensors to implement the above interactive operations by conventionaltechnical measures.

Next, the system will be described with reference to FIG. 1 and FIG. 2 .FIG. 2 is a schematic diagram of some further structures of an augmentedreality system supporting customized multi-channel interaction accordingto the present disclosure. As shown in FIG. 1 and FIG. 2 , the augmentedreality system further comprises an augmented reality window 3 displayedto the display module 5. The augmented reality window 3 is used todisplay the display content of the augmented reality. To be specific,the shape and size of the augmented reality window 3 can be set by usersthemselves or the system defaults. To be specific, the user inputs theshape and size of the augmented reality window 3 through ahuman-computer interactive operation interface. The shape can be round,rectangular, etc. The size may be the side length of the above shape,the center of a circle, and so on.

Further, the augmented reality window 3 may be back-projected to thenear-eye end of the user to form a virtual window 4. The shape of thevirtual window 4 is the same as the shape of the augmented realitywindow 3. The distance between the virtual window 4 and the user affectsthe size of the augmented reality window 3. That is, when the virtualwindow 4 is close to the user, the size of the augmented reality window3 presented to the display module 5 becomes larger. Therefore, withoutthe user moving, the size of the augmented reality window 3 can beadjusted by adjusting the distance between the virtual window 4 and theuser.

The position where the augmented reality window 3 is displayed to thedisplay module 5 is determined through the following steps:

The first step is to establish a coordinate system according to thedisplay range of the display module 5.

In some embodiments, a point can be selected in the display range of thedisplay module 5 as the origin of coordinates. Further, a three-axiscoordinate system is established on the basis of the origin. As anexample, the upper left corner of the display range of the displaymodule 5 may be determined as the origin of coordinates, and the lengthdirection may be the X-axis, the height direction is taken as the Yaxis, the vertical direction between the user and the display module 5is the Z axis, thereby forming a three-axis coordinate system.

The second step is to determine according to the following formula thepoint coordinates of the point on the boundary line where the virtualwindow 4 is projected to the display module 5:PA _(i)=λ_(i) PP _(i);

Wherein P represents the coordinates of the center point of the twoeyes, wherein the coordinates of the point P can be determined throughrelated algorithms. For example, the PNP (Perspective-n-Point) algorithmor the EPNP (Efficient Perspective-n-Point) algorithm can obtain thecenter point coordinates of the two eyes through key point detection,coordinate system conversion, and so on.

P_(i) represents the coordinates of the i^(th) point on the edge of thevirtual window 4, wherein the size of the augmented reality window 3 canbe adjusted by adjusting the distance between the virtual window 4 andthe user without the user moving. When determining the size of theaugmented reality window, the distance from the virtual window 4 to theuser is known. In turn, the coordinates of the i^(th) point on the edgeof the virtual window 4 can be determined through the size, shape, and Ppoint coordinates of the virtual window 4.

A_(i) represents the point coordinates of the point where the straightline formed by starting from point P as the origin and passing throughpoint P_(i) intersects the display module 5;

PA_(i) represents the distance from point P to A_(i);

PP_(i) represents the distance from point P to P_(i), wherein the valueof PP_(i) can be determined through the coordinates of point P and thecoordinates of point P_(i);

λ_(i) represents the quotient of PA_(i) and PP_(i), and λ_(i) isdetermined by the Z-axis coordinates of the three points P, A_(i), andP_(i). To be specific, the distance from the virtual window 4 to theuser is known, and the distance from the display module to the user canbe determined through the coordinates of point P.

The value of PA_(i) can be calculated by the above formula. Since thepoint A_(i) is presented on the display module 5, the coordinates ofpoint A_(i) can be determined according to the value of PA_(i).

In the end, the point coordinates of multiple points on theabove-mentioned boundary can determine the display range of theaugmented reality window and the display position on the display module.

Further, the computing device may determine the object in the displaycontent that the user's eyeballs are focusing on by using the followingformula:λ₁*λ₂*λ₃>0;

Wherein λ₁ is determined by the following formula:

$\lambda_{1} = \left\{ {\begin{matrix}{1,\ {{\left( {x - x_{r}} \right)^{2} + \left( {y - y_{r}} \right)^{2} + \left( {z - z_{r}} \right)^{2}} \leq r^{2}}} \\{0,\ {{\left( {x - x_{r}} \right)^{2} + \left( {y - y_{r}} \right)^{2} + \left( {z - z_{r}} \right)^{2}} \geq r^{2}}}\end{matrix};} \right.$

Wherein (x, y, z) are the coordinates of the object in the displaycontent, wherein the coordinates of the display content object can bedetermined in a variety of ways, for example, the coordinates can bedetermined by a target detection algorithm or a related spatialcoordinate algorithm. In addition, the technician can also preset thecoordinates of the object in advance.

(x_(r), y_(r), z_(r)) are the three-dimensional focus point coordinatesof the left and right eye sight direction, where the three-dimensionalfocus point coordinates can be determined by the existing trackingsensors.

r represents the attention radius; wherein the spherical range formed bythe attention radius represents the preset range of the focus point,wherein the above attention radius may be determined by a technicianthrough a lot of experiments. It can also be set by the computing deviceby default.

In response to λ₁=1, it indicates that the object is in the preset rangeof the focus point.

In response to λ₁=0, it indicates that the object is out of the presetrange of the focus point.

Wherein λ₂ is determined through the following formula:

$\lambda_{2} = \left\{ {\begin{matrix}{1,\ {t \geq t_{d}}} \\{0,\ {t < t_{d}}}\end{matrix};} \right.$

Wherein t represents the time that the focus point continuously selectsthe object within the preset time period, which may be that the focuspoint overlaps the display range of the object, t_(d) is the presetthreshold of the time, wherein the preset time and the preset thresholdcan be determined by a technician through a large number of experiments,or set by the computing device by default.

In response to λ₂=1, it indicates that the time the object has beenfocused on exceeds a preset threshold;

In response to λ₂=0, it indicates that the time the object has beenfocused on is less than a preset threshold;

Wherein the specific formula of λ₃ is as follows:

$\lambda_{3} = \left\{ {\begin{matrix}{1,\ {x_{\min} \leq x \leq {x_{\max}\ {and}\mspace{14mu} y_{\min}} \leq y \leq y_{\max}}} \\{0,\ {x_{\min} > {x\ {or}\mspace{14mu} x} > {x_{\max}\ {or}\mspace{14mu} y_{\min}} > {y\ {or}\mspace{14mu} y} > y_{\max}}}\end{matrix};} \right.$

Wherein (x_(min), x_(max)) represents the minimum and maximum values ofthe augmented reality display window in the x-axis direction, (y_(min),y_(max)) represents the minimum and maximum values of the augmentedreality display window in the y-axis direction;

λ₃=1 means that the object is inside the augmented reality displaywindow;

λ₃=0 means that the object is outside the augmented reality displaywindow.

Furthermore, in response to when the number of objects in the displaycontent that the eyeballs have focused on is multiple, the computingdevice determines through the following steps the order in which themultiple objects are displayed:

For the determined objects that the eyeballs have focused on, theprobability of each object being displayed is determined by thefollowing formula:

${P_{i} = {1 - {\min\;\left( {1,\frac{d_{i}}{r}} \right)}}};$

Wherein P_(i) represents the probability of the i^(th) object beingdisplayed;

d_(i) represents the distance between the i^(th) object and the gazepoint; and

The object to be displayed first is determined according to theprobability of each of the objects being displayed.

In some modes of implementation of certain optional embodiments,responsive to the display module displaying a plurality of augmentedreality windows, and the object of the display content being in therange of the plurality of augmented reality windows or the object beingselected by a plurality of the interactive operations, the computingdevice displays one by one the objects modified by each of theinteractive operations, and displays them in each of the aforementionedaugmented reality windows. Next, description will be made in combinationwith FIG. 3 . FIG. 3 is an application scenario diagram of an augmentedreality system supporting customized multi-channel interaction used bymore than one person according to the present disclosure. When thedisplay module shows two augmented reality windows (31 and 32 in thefigure). When the display content of each of the above augmented realitywindows comprises the same object 6, and when the object 6 is selectedor modified by the user's interactive operation, the scenes when theabove interactive operations change the object 6 can be displayed insequence according to the set factors. The above-mentioned set factorsmay be the time when the user's interactive operations occur, or may bea sequence set for different users in advance.

In the augmented reality system disclosed in some embodiments of thepresent disclosure, the virtual window formed by back-projection of theaugmented reality window can adjust the size of the augmented realitywindow by adjusting the distance between the virtual window and theuser. In this way, the user can customize the size of the augmentedreality window to improve the user's experience.

In addition, as the user's perspective changes, the position of theaugmented reality window displayed at the display module may change. Byconstructing a three-axis coordinate system on the display module, andat the same time, based on the coordinates of the virtual window and theuser, the position of the point of the augmented reality window edge onthe display module can be accurately determined, thereby determining theposition of the augmented reality window in the display module.Therefore, a reasonable position of the augmented reality window on thedisplay module is displayed according to the change of the user'sperspective, which can more vividly and appropriately display thecontent of augmented reality, thus improving the user's experience.

Besides, the object in the display content that the user's eyes havefocused on is determined by determining the preset range of the user'sfocus point, the time of the object being focused on, and whether theobject is within the range of the augmented reality display window. Inthis way, the object which the user has focused on can be accuratelydetermined, and thereby displayed precisely, thus improving the accuracyof the system as well as the user's experience.

The above description is only a preferred embodiment of the presentdisclosure and an explanation of the applied technical principles. Thoseskilled in the art shall understand that the scope of the inventioninvolved in the present disclosure is not limited to the technicalsolutions formed by the specific combination of the above technicalfeatures, but should also cover other technical solutions formed by anycombination of the above technical features or their equivalents withoutdeparting from the inventive concept, for example, technical solutionsformed by mutually replacing the above features with the technicalfeatures disclosed in the present disclosure (but not limited to) withsimilar functions.

The invention claimed is:
 1. An augmented reality system supportingcustomized multi-channel interaction, wherein the augmented realitysystem comprises a head-mounted sensor assembly, a computing device, anda display module; the head-mounted sensor assembly is used to capture amulti-channel interactive input information of a user and transmit theinteractive input information to the computing device; the computingdevice is used to generate or modify a display content of an augmentedreality according to the interactive input information; and the displaymodule is used to overlay display a background content with the displaycontent of the augmented reality, wherein the display module is set to afar end relative to the head-mounted sensor assembly; wherein the systemfurther comprises an augmented reality window displayed to the displaymodule, the augmented reality window being used to display the displaycontent of the augmented reality, and a position where the augmentedreality window is displayed onto the display module is determinedthrough the following steps: establishing a coordinate system accordingto a display range of the display module; determining, based on thefollowing formula, point coordinates of a point on a boundary line wherea virtual window is projected to the display module:PA _(i)=λ_(i) PP _(i); wherein P represents coordinates of a centerpoint of two eyes; P_(i) represents coordinates of an i^(th) point on anedge of the virtual window; A_(i) represents point coordinates of apoint where a straight line formed by starting from point P as an originand passing through point P_(i) intersects the display module; PA_(i)represents a distance from point P to A_(i); PP_(i) represents adistance from point P to P_(i); λ_(i) represents a quotient of PA_(i)and PP_(i), and λ_(i) is determined by Z-axis coordinates of threepoints P, A_(i), and P_(i).
 2. The augmented reality system according toclaim 1, wherein the position of the augmented reality window isdetermined through a posture of a head of the user relative to thedisplay module, thereby simulating a real effect of the display contentof the augmented reality; a shape and size of the augmented realitywindow are determined by setting a shape of the virtual window, whereinthe virtual window is a near-eye window formed by back projection of theaugmented reality window.
 3. The augmented reality system according toclaim 1, wherein the computing device determines by the followingformula an object in the display content that an eyeball focuses on:λ₁*λ₂*λ₃>0; wherein λ₁ is determined by the following formula:$\lambda_{1} = \left\{ {\begin{matrix}{1,\ {{\left( {x - x_{r}} \right)^{2} + \left( {y - y_{r}} \right)^{2} + \left( {z - z_{r}} \right)^{2}} \leq r^{2}}} \\{0,\ {{\left( {x - x_{r}} \right)^{2} + \left( {y - y_{r}} \right)^{2} + \left( {z - z_{r}} \right)^{2}} \geq r^{2}}}\end{matrix};} \right.$ wherein (x, y, z) are coordinates of the objectin the display content; (x_(r), y_(r), z_(r)) are three-dimensionalfocus point coordinates of a left and right eye sight direction; rrepresents an attention radius; wherein a spherical range formed by theattention radius represents a preset range of the focus point; inresponse to λ₁=1, it indicates that the object is in the preset range ofthe focus point; in response to λ₁=0, it indicates that the object isout of the preset range of the focus point; wherein λ₂ is determinedthrough the following formula: ${\lambda_{2} = \left\{ \begin{matrix}{1,\ {t \geq t_{d}}} \\{0,\ {t < t_{d}}}\end{matrix} \right.}\;;$ wherein t represents a time that the focuspoint continuously selects the object within a preset time period, andt_(d) is a preset threshold of the time; in response to λ₂=1, itindicates that the time the object has been focused on exceeds thepreset threshold; in response to λ₂=0, it indicates that the time theobject has been focused on is less than the preset threshold; whereinspecific formula of λ₃ is as follows:$\lambda_{3} = \left\{ {\begin{matrix}{1,\ {x_{\min} \leq x \leq {x_{\max}\ {and}\mspace{14mu} y_{\min}} \leq y \leq y_{\max}}} \\{0,\ {x_{\min} > {x\ {or}\mspace{14mu} x} > {x_{\max}\ {or}\mspace{14mu} y_{\min}} > {y\ {or}\mspace{14mu} y} > y_{\max}}}\end{matrix};} \right.$ wherein (x_(min), x_(max)) represents minimumand maximum values of the augmented reality display window in an x-axisdirection, (y_(min), y_(max)) represents minimum and maximum values ofthe augmented reality display window in a y-axis direction; λ₃=1 meansthat the object is inside the augmented reality display window; and λ₃=0means that the object is outside the augmented reality display window.4. The augmented reality system according to claim 3, wherein when anumber of the objects in the display content that the eyeballs havefocused on is multiple, the computing device determines through thefollowing steps an order in which the multiple objects are displayed:for the determined objects that the eyeballs have focused on, aprobability of each object being displayed is determined through thefollowing formula:${P_{i} = {1 - {\min\left( {1,\frac{d_{i}}{r}} \right)}}};$ wherein P₁represents the probability of an i^(th) object being displayed; d_(i)represents a distance between the i^(th) object and a gaze point; rrepresents a radius of a spherical area; and based on the probability ofeach of the objects being displayed, determine the object to bedisplayed first.
 5. The augmented reality system according to claim 1,wherein in response to the display module displaying multiple augmentedreality windows, and the objects of the display content being within arange of the multiple augmented reality windows or the objects beingselected by multiple interactive operations, the computing devicedisplays one by one the objects modified by each of the interactiveoperations.
 6. The augmented reality system according to claim 5,wherein the background content comprises acquired images or videos, andgenerated virtual dynamic or static scenes.
 7. The augmented realitysystem according to claim 5, wherein the augmented reality displaycontent comprises images or videos, generated virtual dynamic or staticscenes or objects, as well as visualization effects of interactiveoperations, the augmented reality display content can be modified inreal time by interactive operations, and only a part of it within therange of the augmented reality window is displayed.
 8. The augmentedreality system according to claim 1, wherein the head-mounted sensorassembly comprises at least one of the following: a camera, amicrophone, a gesture sensor, and an eye movement tracking sensor, andthe interactive operation characterized by the interactive inputinformation comprises at least one of the following: a gestureinteractive operation, a voice interactive operation and an eye movementinteractive operation.
 9. The augmented reality system according toclaim 1, wherein a display mode of the display module comprises atwo-dimensional plane display and a three-dimensional space display, andwhen the display module performs the two-dimensional plane display, thedisplay module comprises at least one of the following: a computermonitor, a tablet computer, and a screen projection; when the displaymodule performs the three-dimensional space display, the display modulecomprises at least one of the following: a 3D projector and a 3Ddisplay.
 10. The augmented reality system according to claim 2, whereinin response to the display module displaying multiple augmented realitywindows, and the objects of the display content being within a range ofthe multiple augmented reality windows or the objects being selected bymultiple interactive operations, the computing device displays one byone the objects modified by each of the interactive operations.
 11. Theaugmented reality system according to claim 1, wherein in response tothe display module displaying multiple augmented reality windows, andthe objects of the display content being within a range of the multipleaugmented reality windows or the objects being selected by multipleinteractive operations, the computing device displays one by one theobjects modified by each of the interactive operations.
 12. Theaugmented reality system according to claim 1, wherein in response tothe display module displaying multiple augmented reality windows, andthe objects of the display content being within a range of the multipleaugmented reality windows or the objects being selected by multipleinteractive operations, the computing device displays one by one theobjects modified by each of the interactive operations.
 13. Theaugmented reality system according to claim 3, wherein in response tothe display module displaying multiple augmented reality windows, andthe objects of the display content being within a range of the multipleaugmented reality windows or the objects being selected by multipleinteractive operations, the computing device displays one by one theobjects modified by each of the interactive operations.
 14. Theaugmented reality system according to claim 4, wherein in response tothe display module displaying multiple augmented reality windows, andthe objects of the display content being within a range of the multipleaugmented reality windows or the objects being selected by multipleinteractive operations, the computing device displays one by one theobjects modified by each of the interactive operations.